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We construct a model that predicts the statistical properties of spike trains generated 
by a sensory neuron. The model describes the combined effects of the neuron's intrinsic 
properties, the noise in the surrounding, and the external driving stimulus. We show that 
the spike trains exhibit universal statistical behavior over short times, modulated by a 
strongly stimulus-dependent behavior over long times. These predictions are confirmed 
in experiments on HI, a motion-sensitive neuron in the fly visual system. 
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Neurons in the central nervous system communicate through the generation of stereo- 
typed pulses, termed action potentials or spikes In many cases these spikes appear 
to occur as a random sequence, even under conditions where external sensory stimuli are 
held constant. It is tempting to describe these responses in terms of stochastic models ||. 
On the other hand, neurons in isolation are described quite accurately by microscopic, 
deterministic models of the form first proposed by Hodgkin and Huxley |4[]. How do these 
microscopic dynamics relate to the observed statistics of spike trains? A crucial ingredient 
in making this link must be the properties of the noise that impinges upon the neuron, 
but we know relatively little about these noise sources. Here we argue that, granting cer- 
tain simple assumptions, there are some universal statistical behaviors of spike trains that 
emerge from a wide class of models, independent of many poorly known details. These 
theoretical results are in good agreement with data from the fly visual system. 

Many isolated neurons generate a regular sequence of action potentials when a constant 
current flows across the cell membrane HH. This behavior is characterized by the relation 
between the frequency of spikes and current, the 11 f/I curve." Microscopic models of 
neural dynamics, in the spirit of Hodgkin and Huxley, aim in part at explaining this 
relation between current and spike frequency @. Rather than trying to pass all the way 
from a microscopic model to a statistical description, we take the f/I curve as the basic 
phenomenological description of the cell. We imagine that input signals s determine a 
frequency f(s) such that spikes occur when the time integral of the frequency crosses a 
full cycle, as indicated schematically in Fig. 1 0. 
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FIG. 1. Block diagram of the model for spike generation. The inputs are a signal s(t) and a noise n(t), which 
are added and passed through the sigmoid-like response function /. The modified signal then passes through 
an integrate-and-fire element, which generates an action potential when the integrated input exceeds a threshold 
(equal to one), and then resets to zero. The output of this process is a train of spikes, occuring at the instants 
where the threshold was crossed. 



Now we would like to "embed" this model neuron in a noisy environment, such as a 
complex sensory network. At this step, we identify s as the external signal to which the 
system is sensitive, generally a time dependent function s(t) ||. The noise is represented 
by the random function n(t), added to the signal at the input of the system. The distri- 
bution of this noise defines an ensemble; averages over this ensemble will be denoted by 
(•■■). For a constant input s, the firing rate of the neuron r(s) is 

r(s) = (f(s + n)). (1) 

This relates the cell's f/I curve, which characterizes the deterministic response to injected 
current, to the spike rate, which is the probability per unit time that the cell will spike 
in response to the stimulus s. The relation ([!]) is observable as the average response to 
repeated presentations of the same stimulus s. Details of the function f(s) are smoothed 
by averaging over the noise, and hence are unobservable for a neuron in its network. 
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In our experiment, a live immobilized fly views various visual stimuli, chosen to excite 
the response of the cell HI. This large neuron is located several layers back from the eyes, 
and receives input from many cells. It is empirically identified as a motion detector, re- 
sponding optimally to wide-field rigid horizontal motion, with strong direction selectivity 
(KJ . The fly watches a screen with a random pattern of bars, moving horizontally with 
a velocity s(t). We record from HI extra-cellularly, and the response is registered as a 
sequence of spike timings [0]]. Figure 2 shows the time-dependent firing rate r(s(t)) of 
HI in response to a random signal s(t). This signal is very slow, and so the relation (JJ) 
can be used locally in time. The plot of firing rate as a function of the instantaneous 
signal value (inset of Fig. 2), gives us r(s), the noise-smoothed version of f(s). 
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FIG. 2. Firing rate of HI as a function of time, averaged over trials: r(t) = (p(^))trials [dots], compared to 
the input signal s(t) [solid line]. We repeat the signal many times to obtain a sampling of the noise ensemble. 
In the experiment, a random pattern of vertical bars is moved rigidly across the visual field with a horizontal 
angular velocity s(t). The units of velocity are spacings of the compound eys lattice (ommatidia) per second. 
Inset: instantaneous relation between r and s, which is a noise-smoothed version of the deterministic response 
/(*) (see Eq§. 



Even for the simple model of Fig. 1, the statistical structure of spike trains can be 
complicated, dependent upon details in the statistics of the noise n(t) and the precise 
form of the function f(s). Universal behavior emerges, however, if we assume that the 
stationary noise n(t) is characterized by a correlation time, £ n , much shorter than the 



typical inter-spike interval, 1/r [12|. With this assumption, all the formulas presented 
below follow from the model via straightforward calculations. We consider first the case 
of a constant input signal, s(t) = s, so that the firing rate is constant, r(s)=r. 

Figure 3 shows the theoretical results together with the experimental data from the 
fly, for three statistical characteristics: the interval distribution (3a), the autocorrelation 
function (3b), and the number variance (3c). Data are presented in gray, and theory in 
solid black lines. All three characteristics depend on two parameters, one of which is the 



3 



average firing rate r. It is convenient to rescale time to dimensionless units r 
these units, our theory has one dimensionless parameter: 



7W = Cn 



(Sf(s + n) 2 ) 
(f(s + n)) ' 



rt. In 



(2) 



where {Sf(s+n) 2 ) = (f (s +n) 2 ) — (f (s + n)) 2 . This parameter depends on the correlation 
time of the noise, £ n , and on the first two moments of f(s + n) averaged over the noise. 
We will see that 7 describes the variability of the neural response, and can interpolate 
between a highly regular response (small 7) and a Poisson-like behavior (large 7) . 
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FIG. 3. Statistical properties of spike trains in the universal regime: experiment and theory. All data are 
taken from an experiment in which dark and light bars forming a random pattern, move across the screen with a 
constant velocity of 0.12 omm/s. (a) Probability distribution of the intervals between successive spikes. Histogram 
of intervals from the experiment [gray bars], and Eq. [] [line]. Inset: fraction of intervals of length less than t 
[gray line], and integral of Eq. ^ [line]. (This way of presenting the data on intervals involves no binning.) (b) 
Autocorrelation function calculated from the data [gray dots] , and Eq. ^ [line] . (c) Number variance as a function 
of number mean, as calculated from the data [gray dots], and Eq.^ [line]. For comparison, the number variance 
of a Poisson process, a straight line of slope 1, is shown by a dashed line. 
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The distribution of intervals between neighboring spikes is (Fig. 3a) fl3| : 

= (1 + 1/r) ^ 

For very short intervals, r< 1, the distribution decays strongly: -P(t) ~ e _1 / 2rr ; this 
is related to neural refractoriness, but it is not a simple absolute refractory period. For 
large intervals, P(t) ~ e~ T / 27 . The width of the distribution relative to its mean can 
be quantified by the coefficient of variation (the standard deviation divided by the mean 
||14j|); for our distribution, this quantity is governed by 7, varying from zero to a constant 
larger than one as 7 increases. For the data presented here, 7 ~ 0.1. 

We can think of the spike train as a sequence of pulses at times tj, p(t) = J2i$(t — 
tj). Then the (dimensionless) autocorrelation function of the spike train, R(t) = 
(P(0)p(r))/(p(0)) 2 , is (Fig. 3b): 

R(r) = e"^ r>0, (4) 

with a symmetric expression for r < 0. The correlation function is composed of an infinite 
sum of functions similar to the interval distribution, with shifted peaks. The number of 
peaks that can be resolved is proportional to I/7: for small 7 there is a pronounced 
"ringing" in the correlation function, as expected for a regular spike train, while for large 
7 this structure is absent, indicating an irregular or nearly Poisson sequence of spike times. 

The number of spikes in a time interval of length r is N(t) = Jq p{r')dr' . It is a random 
variable and its variance can be expressed as an integral of the correlation function: 
(6N 2 ) = 2£(t - T')R(T')dT' @. Using Eq. (|), we find (Fig. 3c): 

-r 1 pil-KmT— 27r 2 m 2 7T 

(6N\t)) = 1T + — J2 v-. (5) 

The number variance consists of a linear term, a constant, and an infinite sum of oscillating 
terms. The linear term comes from the integration of the 5-function part of the correlation 
function, at r = (omitted from Eq. ^). The oscillatory term decays exponentially, 
therefore for long times (57V 2 ) ~ 7r + c/2, with c = 1/3 + 7 2 — 7coth(l/7). 

Imagine now that the input signal has a time dependence, s(t), and consider first the 
case where it is very slow. Then, the description given above holds over short time 
scales. Figure 4a shows the autocorrelation function of spike trains from four different 
experiments, with different input signals. Scaling the different data plots to dimensionless 
time r — rt, we see that they overlap over short times (r < 2): the short-time behavior is 
universal. This universality cannot be explained by the existence of a constant refractory 
period: the plots are in dimensionless time units, and the region of universality extends 
well beyond any reasonable absolute refractory time. Quantitative universality requires, 
moreover, that the value of 7 be similar for these very different stimulus conditions. It 
seems likely that this approximate constancy of 7 occurs by adaptation of the fly's visual 
system to the different stimulus ensembles. 
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FIG. 4. Correlation functions in the universal (a) and non-universal (b-d) regimes, (a) Data from 4 different 
experiments are superposed. The time axis is normalized to dimensionless units, and the horizontal axis is 
normalized by the value at the first peak. The graphs are very similar for short times, indicating the short-time 
universality, and begin to depart at longer times, (b-d) Experimental data [gray dots] are compared to theoretical 
results [black lines] for the different signals: constant signal (b), Sine wave signal of period 0.25 sec (c), random 
signal with a 5Hz bandwidth (d). Theoretical curves in (b-d) are calculated from known properties of the input 
signal by Eq. fj with no adjustable parameters. 



On longer times, as the oscillations of the universal regime decay, the curves begin to 
reflect correlations in the input signal (Fig. 4b-d). This behavior can be predicted from 
the model to take the approximate form [[DJ 

1 + k/r) 



R(r) « r(*(0))r(«(r)) E Z 'J . (6) 

k& V87T7T 

Note that the short-time behavior (in the sum) involves only the parameter 7 that can 
be fit in the universal regime, while the correlation function of the rates can be computed 
from the input/output relation in the inset of Fig. 2. In many cases simple approximation 
to this relation (e.g., a step function) give accurate results for the correlation function; 
thus we can predict correlation functions, at least approximately, with no new parameters. 
Figure 4 shows the long-time correlation function for various input signals: a constant 
signal (4b), a sine wave of period 0.25 sec (4c), and a random signal of bandwidth 5 
Hz (4d). The differences between the various signals show up clearly in the long-time 
behavior of R(t), and follow the theoretical prediction of Eq. E (black lines). 
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In conclusion, we have constructed a simple model that predicts the statistical behavior 
of spike trains in the neuron HI of the fly visual system. The model is insensitive to 
the microscopic details of the spiking neuron; these are represented phenomenologically 
by the frequency-current response f(s). When the model neuron is embedded in a noisy 
environment, the spike trains exhibit universal statistical behavior over short time scales, 
in which only the first two moments of f(s) are important. These are represented in the 
theory by the two parameters r and 7. In any particular case, it remains a challenge 
to understand the microscopic origins of these parameters, but clearly many different 
microscopic models can generate the same value of 7, and hence the same statistics for 
the spike train as measured by the inter-spike interval distribution and the short-time 
behavior of the autocorrelation function. On longer time scales, this universal behavior 
is modulated by the statistical properties of the input signal. The independence of the 
model on details and the weakness of the assumptions made, suggest that the results may 
be valid for a wider class of neurons. 
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